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Overview 


Transforming Education Through the Arts and Media (TEAM) is an arts integration program based on the 
concept of the 21“ century transliterate learner who acquires knowledge and interacts across a range of 
tools, platforms, and media. Over a period of four years, TEAM was implemented in seventh- and 
eighth-grade classrooms by the Center for Community Arts Partnerships (CCAP) at Columbia College 
Chicago in collaboration with Chicago Public Schools (CPS). The fourth year of TEAM was completed 
in the 2013-14 school year. Funding was provided in part by a four-year grant from the Department of 
Education through the Arts in Education-Model Development and Dissemination (AEMDD) Grants 
Program. 


TEAM had two primary goals: a) Increasing student motivation and achievement through media arts 
projects, and b) Increasing teacher capacity to integrate media arts and technology in classroom practice. 
In all four years, teaching artists from Columbia College were paired with classroom teachers to provide 
arts-integrated instruction in core curriculum units. During the artist residencies, teachers and students 
learned filmmaking, blogging, web design, gaming, digital photography, or other technology-based art 
forms to obtain an enhanced understanding of academic content and the world around them. In addition, 
professional development was provided to the classroom teachers to increase their media arts skills and 
their understanding of media arts integration strategies. 


Over the four years of implementation, approximately 1,200 seventh- and eighth-grade students in five 
Chicago schools participated in TEAM. Student enrollment in the participating schools was comprised of 
88% to 100% students of color and 92% to 99% low-income. From 40% to 74% of students met or 
exceeded proficiency in all tested subjects. Additional demographic information about the participating 
schools is presented in Appendix A. In addition to students, a total of 30 classroom teachers, 18 
Columbia College teaching artists, and 22 Columbia College student assistants also participated in 
TEAM. 


Because the TEAM program model was designed to respond to changes in the learning environment, a 
developmental evaluation approach was utilized. Developmental evaluation is appropriate for dynamic 
situations where goals, participants, and/or settings are expected to keep changing as a program evolves. 


TEAM’s first year was a planning year in which the TEAM staff learned about their participants from 
pilot data that were collected. Based on results of the pilot, several modifications were made to program 
delivery and to the evaluation instruments. Over its four years, TEAM experienced additional changes 
such as changes in the participating schools, teacher partners, and methods of program delivery. 
Throughout the changes, TEAM evaluators tracked outcomes of participating students related to 
technology skills, academic engagement and motivation, and achievement in reading and mathematics. 
Also tracked were outcomes related to participating teachers’ capacity to integrate media arts and 
technology into classroom practice. The purpose of this report is to present TEAM’s successes and 
challenges and to share insights regarding strategies to ensure that teachers will continue to utilize media 
arts integration on their own when they are no longer collaborating with teaching artist partners. 
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Data Collection Methods 


Pre- and post-residency surveys were administered each year to teachers to gather information on how 
they used media arts and technology in their classrooms, their capacity to integrate media arts and 
technology, their perceptions of their students’ growth in media arts skills, and their perceptions of the 
teacher-teaching artist collaboration. Pre- and post-residency surveys were also administered to students. 
The student surveys were designed to gather information on their academic motivation and engagement, 
their media and technology skills and attitudes, and their perceptions of working with a TEAM teaching 
artist. In addition, pre- and post-residency scores on the Illinois Standards Achievement Test (ISAT) 
were obtained for both participating and comparison students. Copies of the teacher and student surveys 
are provided in Appendices B through E. 


Planning Year (Year 1) Results 


TEAM’s first year, 2010-11, was a planning year that included the implementation of pilot residencies. 
The pilot residencies were conducted in core courses during the spring semester over a period of 1 to 2 
months for approximately 1 to 2 hours each week. Pre- and post-residency surveys were developed and 
were administered to the teacher and student participants before the teaching artist residencies began and 
immediately after the residencies were completed. The results of analyses carried out on the pilot data 
helped the TEAM staff learn about their participants. They were especially interested in participants’ 
responses related to communication, consumption, and creation uses of media arts. The adequacy of the 
survey instruments was also examined. 


The major findings of the planning year surveys are shown below. 


e TEAM students had a great deal of familiarity and experience with many types of technology and 
media arts. 

e TEAM students possessed more skills and knowledge related to the use of media for 
communication (e.g., texting) and for consumption (e.g., playing video games) than for creation 
(e.g., creating a website). 

e TEAM teachers had less experience and lower skill levels in using technology and media arts 
than their students. 

e Very few TEAM teachers integrated media arts into classroom instruction on a regular basis. 


TEAM staff responded to the planning year findings with decisions regarding program emphasis and 
professional development experiences for participating teachers. Evaluators, together with program staff, 
responded by reviewing and revising the student and teacher survey instruments. Actions that were taken 
are listed below. 


e The TEAM program model was modified to place special emphasis on creating and on the social 
aspects of connecting, communicating, and collaborating. 

e Professional development for teachers was designed to increase skill levels and knowledge 
related to integration of technology and media arts. 

e Survey instruments were revised to obtain data regarding new media literacy skills rather than 
competencies related to specific tools. 

e Response scales were modified to make survey feedback more informative for TEAM program 
staff. 


Center for Applied Research and Educational Improvement 2 
University of Minnesota 


Results of Surveys Administered to Students in 
TEAM Program Years (Years 2 to 4) 


Differences between students’ pre- and post-residency survey responses were analyzed via nondirectional 
Wilcoxon signed ranks tests with the type 1 error probability set at .05 for each test. Statistically 
significant differences are noted in the summary tables and are discussed in the following sections. 
Results are summarized by four areas: a) Students’ computer skills, b) Students’ behaviors and skills 
related to consumption of media, c) Students’ behaviors and skills related to communication using media, 
and d) Students’ behaviors and skills related to creation using media. 


¢ Students’ Computer Skills 


The pre- and post-residency questionnaires administered to students asked them to rate their skill levels 
on several computer-related tasks. The results are displayed in Table 1. Statistically significant increases 
were noted in the students’ self-ratings of their skills in: 


sing video, sound, or pictures in Power Point or Keynote in presentations for class 
ownloading and installing software from the Internet 

ploading or editing photos, videos, and sound 

sing photos, videos, and sound in class presentations 

sing tools like spell check, calculator, and thesaurus 

sing Google Maps to find information about a neighborhood 

sing Excel to make a data base 


oeeee ee 
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Only one of these skills, however, was associated with a significant increase in all three years. That was 
the skill of uploading or editing photos, videos, and sound. Ratings of the other skills were associated 
with a statistically significant increase in only one or two of the three program years. One skill did not 
have a significant pre-post difference in any of the program years. That skill was the one of learning how 
to do something new on a computer, camera, phone, or other device by seeing what happens when 
playing around with it. Differences in results regarding the students’ computer skills from one year to the 
next were likely due to the specific skills needed for the projects designed collaboratively by the teaching 
artist-classroom teacher pairs for each classroom and the students’ entry-level skills. 


e Students’ Behaviors and Skills Related to Consumption of Media 


Students responded to eight survey items regarding consumption of media. They gave their responses 
using a four-point agreement scale: Strongly disagree, kind of disagree, kind of agree, strongly agree. 
Table 2 displays a summary of the analysis results. Across TEAM program years 2 to 4, only four pre- 
post differences were statistically significant. Three of the significant differences were associated with 
increases in agreement and one was associated with a decrease. A comparison of the pre- and post- 
residency responses given by students in the second program year indicated that they increased their 
ability to recognize prejudice or bias in media and that they thought more about how people their own 
age, ethnicity, and gender are represented in movies, TV shows, and magazines. In the fourth program 
year, a comparison of pre- and post-residency responses indicated students became more particular about 
what they watched, read, and listened to and that they were more likely to visit only websites they knew 
were safe. The result regarding the latter behavior in year 4 was especially noteworthy since the pre-post 
difference in agreement was an increase of 63 percentage points. The significant decrease in agreement 
occurred in year 3 for the item concerning following favorite books, actors, shows, and musicians across 
different platforms and media. The agreement rate for this item decreased from 83% to 80% Overall, 
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Table 1. Students’ Self-Ratings of Their Computer-Related Skills, TEAM Program Years 2 to 4 


Computer-Related 


(Response Scale: No Experience = 1, Basic = 2, Intermediate = 3, Expert = 4) 


Students’ Mean Skill Ratings 


Skill Year 2 (2011-12) Year 3 (2012-13) Year 4 (2013-14) 
n Pre Post Dp n Pre Post Dp n Pre Post Dp 
Use video, sound, or 
pictures in Power 2.52 2.80 2.56 2.75 2.68 2.79 
Point or Keynote in 20%, aeey I GeNGl ee | (eee ORO: Oe || See ||! ee eer kogene: He 
presentations for class 
Use Excel to make a 
2.14 2.39 2.22 2.23 2.24 2.29 
database or solve math 283 : . <.001 379 : : ns 182 : : ns 
problems (0.81) | (0.79) (0.81) | (0.83) (0.82) | (0.86) 
Upload or edit my 
2.96 3.18 2.83 2.99 2.93 3.10 
own photos, videos, 281 <.001 383 .001 182 01 
areata: (0.93) | (0.85) (0.94) | (0.91) (0.79) | (0.84) 
Download and install 
2.85 2.99 2.77 2.90 2.99 2.95 
software from the 284 (1.04) | (0.98) .008 381 (0.98) | (0.96) .006 184 (0.91) | (0.90) ns 
Internet. 
Use Google Maps to 
find information about 3.14 3.29 3.24 3.20 3.27 3.28 
a neighborhood or geP MOY | @824\; oe, | ee eee) | Ko-89): ||| PI 0.77) (0.75).|, 2 
certain location 
Use tools like spell 
check, calculator 
, : 3.44 3.54 3.38 3.43 3.44 3.47 
dictionary, thesaurus, 283 : : .012 382 : , ns 182 , : ns 
ote: te help ine ininy (0.68) | (0.63) (0.71) | (0.72) (0.62) | (0.64) 
learning or work 
Learn how to do 
something new ona 
computer, camera, 
. 3.28 3.35 3.24 3.28 3.26 3.28 
phone, or other device 283 (0.74) | (0.72) ns 383 (0.75) | (0.75) ns 183 (0.75) | (0.74) ns 


by seeing what 
happens when playing 
around with it 
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Table 2. Students’ Behaviors and Skills Related to Consumption of Media, Team Program Years 2 to 4 


Agreement Rate 


Behavior or Skill Related to (% of Students Selecting Kind of Agree or Strongly Agree) 
Consumption of Media Year 2 (2011-12) Year 3 (2012-13) Year 4 (2013-14) 
n Pre Post D n Pre Post D n Pre Post D 


I am very picky about what I watch read, and 


. 281 | 73% | 78% ns 376 74% | 77% | .001 178 | 70% 80% .016 
listen to. 


When I’m interested in a topic or issue, I try to 
get information from a bunch of different sources 
(like TV, radio, the Internet, etc.) to understand it 
more fully. 


281 | 85% | 88% ns 380 | 87% | 88% ns 180 | 81% | 85% ns 


When I search for something online and I get 
thousands of results, I can effectively decide 279 | 85% | 86% ns 370 | 88% | 91% ns 178 | 90% | 89% ns 
which ones will be the most useful for me. 


I follow my favorite books, actors, shows, 
musicians, etc. across different platforms and 
media (TV, magazines, Internet, Facebook, 
Twitter, etc.). 


281 | 78% | 82% ns 376 | 83% | 80% | .028 | 180 | 82% | 82% ns 


I can recognize prejudice or bias in media 


: : 279 | 78% | 90% | <.001 | 372 | 81% | 84% ns 179 | 91% | 92% ns 
(racism, sexism, etc.). 


I can tell whether or not an online information 


: . 278 | 82% | 87% ns 375 | 86% | 87% ns 178 | 87% 89% ns 
source is reliable and accurate. 


I think about how people my age, ethnicity, and 
gender are represented in movies, TV shows, and | 276 | 76% | 86% | .004 | 369 | 80% | 80% ns 177 | 72% | 76% ns 
magazines. 


I only visit websites I know are safe. 281 | 75% | 76% ns 372 | 83% | 78% ns 178 | 20% | 83% | <.001 
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the results indicate that, prior to participating in TEAM, the students were already exhibiting fairly high 
levels of media consumption, and in two of TEAM’s programs years, the teaching artist residencies 
helped the students to become more cautious and discerning as consumers of media. 


¢ Students’ Behaviors and Skills Related to Communication Using Media 


Students responded to six survey items that concerned communication using media (see Table 3). The 
same agreement scale described earlier was also used for these items. Two items were associated with a 
statistically significant pre-post difference. The pre-post difference for the item that stated “I act, talk, 
and treat people differently online than I do in person” was statistically significant only in year 2, and the 
difference was an increase in agreement. The other significant pre-post difference was a decrease. That 
item concerned sharing links and videos on media sites like Facebook, YouTube, or Twitter. It is difficult 
to detect any pattern in the results regarding communication using media. The number of increases was 
approximately equal to the number of decreases, and the pattern in the differences was not consistent over 
the three years for any of the six items. 


¢ Students’ Behaviors and Skills Related to Creation Using Media 


Results of statistical tests carried out on the six items concerning creation indicate that TEAM was very 
successful in promoting students’ creative activities in program years 2 and 4 (see Table 4). In both of 
these program years, TEAM students significantly increased their ability to tell stories in different ways, 
such as through photography, video, writing, and drawing, and their ability to create art or media that 
represents who they are. In addition, in both of these years, students became significantly more confident 
in sharing their work with others, not only with their classmates but also with a larger audience online. 
An additional pre-post increase that was statistically significant only in year 4 indicates that students who 
participated that year increased their knowledge of using visual clues to get across information about a 
character, setting, or other concepts. The results for year 3, however, were quite different. The pre- 
residency agreement rates were somewhat higher than in the other two years, and none of the pre-post 
differences were statistically significant. 
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Table 3. Students’ Behaviors and Skills Related to Communication Using Media, TEAM Program Years 2 to 4 


Behavior or Skill Related to 
Communication Using Media 


Agreement Rate 


(% of Students Selecting Kind of Agree or Strongly Agree) 


Year 2 (2011-12) 


Year 3 (2012-13) 


Year 4 (2013-14) 


Pre 


Post 


Pp 


Pre Post 


Pp 


Pre 


Post 


I enjoy using things like Wikipedia, team games, 
online fan communities, and community message 
boards to collaborate and have conversations 
with people I’ve never met. 


56% 


62% 


ns 


59% | 59% 


ns 


64% 


62% 


ns 


I like to share links, videos, and other cool stuff 
on social media sites like Facebook, YouTube, or 
Twitter. 


282 


80% 


83% 


ns 


375 


76% | 79% 


ns 


174 


78% 


70% 


.024 


When I can’t solve a problem or find a piece of 
information by myself, I use the Internet or social 
media to connect with others and find what I am 
looking for. 


284 


85% 


89% 


ns 


376 


90% | 88% 


ns 


176 


93% 


90% 


ns 


When I go online, I feel like I am part of a 
community. 


273 


64% 


69% 


ns 


376 


70% | 66% 


ns 


177 


70% 


68% 


ns 


I act, talk, and treat people differently online than 
I do in person. 


279 


38% 


48% 


.026 


372 


46% | 43% 


ns 


179 


51% 


533% 


ns 


I often comment on articles, photos, or videos 
online. 


283 


69% 


66% 


ns 


374 


68% | 62% 


ns 


179 


45% 


54% 


ns 
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Table 4. Students’ Behaviors and Skills Related to Creation Using Media, TEAM Program Years 2 to 4 


Behavior or Skill Related to 
Creation Using Media 


Agreement Rate 


Year 2 (2011-12) 


Year 3 (2012-13) 


Year 4 (2013-14) 


Pre Post 


Pre Post 


p 


Pre Post D 


I can tell stories in different ways, such as 
through photography, video writing, drawing, 
etc. 


73% | 79% 


84% | 80% 


ns 


27% | 75% | <.001 


I can create art or media that represents who I 
am. 


72% | 80% 


76% | 80% 


ns 


26% | 79% | <.001 


I feel confident sharing my original creative 
work with my classmates. 


65% | 76% 


74% | 73% 


ns 


31% | 72% | <.001 


I feel confident sharing my original creative 
work with a larger audience online. 


51% | 63% 


54% | 61% 


ns 


42% | 55% 022 


When making a video or creating an image, I 
know how to use visual clues to get across 
information about a character, setting, or other 
concepts (for instance, the type of clothing a 
character wears might tell us about them before 
they even speak). 


279 


77% | 81% 


ns 


378 


79% | 81% 


ns 


178 


21% | 81% | <.001 


I consider myself a media artist or producer.* 


281 


48% | 48% 


ns 


373 


94% | 57% 


ns 


178 


91% | 47% ns 


*Note: The words “or producer” were omitted in years 3 and 4. 
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¢ Supplementary Analyses of Survey Responses Given by Students Who Were TEAM 
Participants in Both Grade 7 and Grade 8 


Supplementary analyses were carried out on the responses of students who participated in TEAM in both 
grade 7 and grade 8 (see Appendix F). Analyses were carried out on two groups of “both grades” 
students: a) TEAM grade 7 participants in year 2 who were also TEAM grade 8 participants in year 3, 
and b) TEAM grade 7 participants in year 3 who were also TEAM grade 8 participants in year 4. In the 
following paragraphs, the results of the “both grades” analyses are compared to the results of analyses 
presented earlier that were carried out on all student participants. The reader should keep in mind that the 
sample sizes for the “both grades” analyses were substantially smaller than the sample sizes for analyses 
carried out on all student participants. Therefore, it is very possible that the “both grades” analyses had 
less statistical power (i.e., a lower probability of finding a statistically significant difference). 


Students’ Computer Skills 


Years 2 to 3: In year 2, fewer items were associated with statistically significant differences for 
the “both grades” analyses (one item) than in the “all students” analyses (six items). The only 
item that was associated with a statistically significant pre- to post-residency increase in both sets 
of analyses was: 


" Use video, sound, or pictures in Power Point or Keynote in presentations for class 


In year 3, the “both grades” and “all students” results were more similar. Three pre-post 
increases were statistically significant in the “all students” analyses and two pre-post increases 
were statistically significant in the “both grades” analyses. The two items that were significant in 
both sets of analyses in year 3 were: 


" Use video, sound, or pictures in Power Point or Keynote in presentations for class 
" Upload or edit my own photos, videos, and sound 


Years 3 to 4: In year 3, four items were associated with a statistically significance increase in 
the “both grades” analyses compared to three items in the “all students” analyses. The three 
items with significant pre- to post-residency increases in both sets of analyses were: 


" Use video, sound, or pictures in Power Point or Keynote in presentations for class 
"Upload or edit my own photos, videos, and sound 
"Download and install software from the Internet 


The additional item that was significant in only the “both grades” analysis was: 


"Use tools like spell check, calculator, dictionary, thesaurus, etc. to help me in my learning 
or work 


In year 4, the “both grades” and “all students” analyses produced exactly the same results. More 
specifically, only one item was associated with a statistically significant pre-post increase, and 


that was: 


"Upload or edit my own photos, videos, and sound 
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e Students’ Behaviors and Skills Related to Consumption of Media 


Years 2 to 3: In year 2, fewer items were associated with statistically significant differences for 
the “both grades” analyses (one item) than in the “all students” analyses (two items). The only 
item that was associated with a statistically significant pre- to post-residency increase in both sets 
of analyses was: 


= Tcan recognize prejudice or bias in media (racism, sexism, etc.). 


In year 3, the “both grades” analyses had no statistically significant differences whereas the “all 
students” analyses had two. 


Years 3 to 4: In year 3, two items were associated with a statistically significance increase in the 
“both grades” analyses and in the “all students” analyses. One of the items was significant in 
both sets of analyses: 


"Tam very picky about what I watch, read, and listen to. 


The item that had a statistically significant pre-post residency increase only in the “both grades” 
analysis was: 


= I can recognize prejudice or bias in media (racism, sexism, etc.). 


In year 4, the “both grades” analyses had one statistically significant pre-post difference whereas 
the “all students” analyses had two. The significant result the two sets of analyses had in 
common was for a pre-post increase in responses given to the item: 


"  T only visit websites I know are safe. 
« Students’ Behaviors and Skills Related to Communication Using Media 


Years 2 to 3: In year 2, no items were associated with a statistically significant difference in the 
“both grades” analyses compared to one item in the “all students” analyses. In year 3, no pre-post 
differences were statistically significant in either set of analyses. 


Years 3 to 4: In year 3, no pre-post differences were statistically significant in either set of 
analyses. In year 4, only one item was statistically significant in both sets of analyses, and it was 
the same item. This item was associated with a statistically significant pre-post residency 
decrease: 


= J like to share links, videos, and other cool stuff on social media sites like Facebook, 
YouTube, or Twitter. 


« Students’ Behaviors and Skills Related to Creation Using Media 


Years 2 to 3: In year 2, the “both grades” and “all students” analyses produced very different 
results. None of the six pre-post differences in the “both grades” analyses were statistically 
significant whereas four of the six were significant pre-post increases in the “all students” 
analyses. In year 3, the results were exactly the same. None of the pre-post differences were 
statistically significant in either the “both grades” analyses or the “all students” analyses. 
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Years 3 to 4: In year 3, none of the pre-post differences were statistically significant in either the 
“both grades” analyses or the “all students” analyses. In year 4, the same four items were 
associated with statistically significant increases in both the “both grades” analyses and the “all 
students” analyses. These items are shown below. 


"  Ican tell stories in different ways, such as through photography, video, writing, drawing, 
etc. 

"  Ican create art or media that represents who I am. 

" I feel confident sharing my original creative work with my classmates. 

"| feel confident sharing my original creative work with a larger audience online. 

=" When making a video or creating an image, I know how to use visual clues to get across 
information about a character, setting, or other concepts. 


In summary, as expected, fewer pre-post residency differences produced statistically significant results in 
the “both grades” analyses as compared to the “all students” analyses. However, the supplementary 
analyses provide additional evidence that TEAM was successful with respect to increasing the students’ 
computer skills especially as related to uploading or editing photos, videos, and sound; and using video, 
sound, or pictures in class presentations. The supplementary analyses also support the conclusion that 
TEAM was successful in helping the students to become more cautious and informed consumers of media 
through heightening their awareness of prejudice or bias. Finally, in its fourth and final year, TEAM 
appears to have been particularly successful in helping students to increase their media creation skills and 
their confidence in sharing their original creative work with others. 
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¢ Benefits to Students’ Learning and Engagement from Working with TEAM Teaching 


Artists, Years 2 to 4 


On the post-residency questionnaire, students were presented with three statements mentioning potential 


learning and engagement benefits from working with TEAM teaching artists (see Figure 1). Students’ 


responses to these items indicate that the TEAM teaching artists had a very positive impact on the 
students. In all three program years, 80% or more of students participating in TEAM indicated that 


working with a TEAM artist in their classes helped them to be more interested and actively involved and 


to learn the academic material better than they would have without TEAM. 


Agreement Rates 
"Working with a TEAM artist from Columbia helped me..." 


Learn the academic material in this class 


better than | would have without TEAM. 


Be more actively involved in this class than | 


would have been without TEAM. 
es -- 


Be more interested in this class than | would 
have been without TEAM. =] 


74% 76% 78% 80% 82% 84% 86% 88% 90% 92% 


m2012 =2013 m2014 


94% 


Figure 1. Students’ Level of Agreement to Statements Concerning Learning and Engagement Benefits of 


Working with a TEAM Artist, TEAM Program Years 2 to 4. 
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¢ Benefits to Students’ School Attendance from Working with TEAM Teaching Artists, 
Years 3 to 4 (APR Performance Measure 3.5) 


Performance Measure 3.5: By June 30, 2012, the percent of project students with daily attendance rates of 
90% or above will be at least 5 percentage points higher than the percent of matched comparison group 
students with daily attendance rates of 90% or above. By June 30, 2013: the percent of project students 
with daily attendance rates of 90% or above will be at least 5 percentage points higher than the percent of 
matched comparison group students with daily attendance rates of 90% or above. By June 30, 2014: the 
percent of project students with daily attendance rates of 90% or above will be at least 5 percentage points 
higher than the percent of matched comparison group students with daily attendance rates of 90% or 
above. 


In the original version of an attendance performance measure submitted to DOE (see Performance 
Measure 3.5 above), TEAM staff described a comparison of attendance rates between TEAM students 
and students in a matched comparison group. Realizing, however, that attendance can be affected by so 
many factors that are unrelated to students’ in-school experiences (e.g., sickness), TEAM staff submitted 
a revision to DOE that would provide an assessment that was more directly related to TEAM students’ 
residency class experiences. The revision, approved by DOE, involved adding an item to the students’ 
post-residency survey that asked about their enthusiasm for attending school on days when the TEAM 
artist was going to be there compared to other days. Responses given to this item indicate that, in TEAM 
program years 3 and 4, at least 74% of the students believed they were more enthusiastic about attending 
school on days when the TEAM artist was going to be there than on other days (see Figure 2). 


Agreement Rates 
"Working with a TEAM artist from Columbia helped me..." 


Be more enthusiastic about attending school on days 
when the TEAM artist from Columbia was going to be 
there than on other days. 


71% 72% 73% 74% 75% 76% 77% 78% 79% 80% 
2013 #2014 


Figure 2. Students’ Level of Agreement to a Statement Concerning School Attendance Benefits of 
Working with a TEAM Artist, TEAM Program Years 3 and 4. 
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¢ Impact of TEAM on Students’ General Motivation and Engagement 
(APR Performance Measure 3.3) 


Performance Measure 3.3: By June 30, 2011, ratio 44/175 and 25% of project students will have 
demonstrated improved motivation and engagement in learning based on responses to a student 
survey questionnaire administered in the fall and spring. By June 2012, ratio 105/350 and 30%. By 
June 2013, ratio 193/350 and 55%. By June 2014, ratio 123/175 and 70%. 


Performance Measure 3.3 (shown above) concerned the motivation and engagement of students 
participating in TEAM. Assessment of TEAM students’ motivation and engagement was carried out by 
first summing their responses to 10 survey items that appeared on both the pre- and post-residency 
surveys (see Table 5). The pre-residency sum for each student was then subtracted from the post- 
residency sum. The percent of students increasing in motivation and engagement from pre- to post- 
residency was calculated and compared to the target established for each program year. 


Table 5. The Ten Student Survey Items That Comprised the Composite Motivation/Engagement Measure 
for Performance Measure 3.3. 


Survey Item 


I like school. 

I use the things I learn in school in other parts of my life. 
When something is difficult, I try different ways to figure it out. 

I participate in class discussions. 

I like solving problems and puzzles. 

I make a plan before starting on a big assignment or project. 

When I’m curious or confused about something, I ask questions or look up information. 
When writing a paper or doing a project, I start with a rough draft and then revise it to make it better. 

I believe what I learn in school can help me make a difference in my community 

I stay informed on current events, politics, and community issues. 


Because revisions were made to the survey instrument used in the first year pilot and item wordings were 
consequently somewhat different in program years 2-4, only the results for years 2-4 are summarized in 
Table 6. The actual percentage of 50% in 2012 exceeded the target percentage of 30%. However, the 
actual percentages of 39% and 44% in 2013 and 2014, respectively, fell short of the target percentages of 
55% and 75%. Therefore, participation in TEAM appeared to increase the general school motivation for 
some of the students but not to the extent that TEAM staff had anticipated. 


Table 6. Percent of TEAM Students Increasing Their Motivation and Engagement from Pre-Residency to 
Post-Residency As Measured by a Set of 10 Items on a Student Survey 


pee ae Target Ratio Target Percentage Actual Ratio Actual Percentage 
Year 2 (2012) 105/350 30% 124/248 50% 
Year 3 (2013) 193/350 59% 129/332 39% 
Year 4 (2014) 123/175 75% 73/167 44% 
Combined Across Years 326/747 44% 
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¢ Impact of TEAM on Students’ Achievement Test Performance (APR Performance 
Measures 3.1 and 3.2) 


Performance Measure 3.1: By June 30, 2014, at least 75% of project students will have made gains in 
both reading and math based on pre and post intervention administration of the ISAT. Target on Status 
Form of Annual Performance Report: baseline only by June 2011, ratio 228/350 and 65% by June 2012, 
ratio 245/350 and 70% by June 2013, and ratio 131/175 and 75% by June 2014. 


Performance Measure 3.2: By June 30, 2014, at least 80% of project students who are English Language 
Learners will have made gains in both reading and math based on pre and post intervention 
administration of the ISAT. Target on Status Form of Annual Performance Report: baseline only by June 
2011, ratio 64/92 and 70% by June 2012, ratio 69/92 and 75% by June 2013, and ratio 33/41 and 80% by 
June 2014. 


Performance Measures 3.1 and 3.2 (shown above) concerned the academic achievement of 
TEAM students in reading and math. For each program year, the performance measures targeted 
the percentage of TEAM students who gained on both their ISAT reading and ISAT math scale 
scores as compared to the scores they received the previous year. Targets were established for 
all students participating in TEAM and separately for the ELL students participating in TEAM. 
The targets and the results are displayed in Tables 7 and 8. 


Table 7. Percent of TEAM Students with Gains on Both Reading and Math ISAT Scale Scores 
(Performance Measure 3.1) 


ae al Target Ratio Target Percentage Actual Ratio Actual Percentage 

Year 2 (2012) 228/350 65% 345/555 62% 

Year 3 (2013) 245/350 70% 283/574 49% 

Year 4 (2014) 131/175 75% 125/280 45% 
Combined Across Years 7953/1409 33% 


Table 8. Percent of TEAM ELL Students with Gains on Both Reading and Math ISAT Scale Scores 
(Performance Measure 3.2) 


ge stake Target Ratio Target Percentage Actual Ratio Actual Percentage 

Year 2 (2012) 64/92 70% 40/50 80% 

Year 3 (2013) 69/92 75% 25/56 45% 

Year 4 (2014) 33/41 80% 12/29 41% 
Combined Across Years 77/135 57% 


In program year 2, the actual percentage for the ELL students was 80%, exceeding the target 
percentage of 70% by 10 percentage points. The actual percentage across all TEAM students in 
program year 2 was 62%, which fell slightly short of the target percentage of 65%. In program 
years 3 and 4, none of the targets were attained. In fact, actual percentages were considerably 
lower than target percentages, with actual versus target differences ranging from 21 to 39 
percentage points. 
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¢ Impact of TEAM on Students’ Achievement Test Performance (GPRA) 


Performance on state-mandated assessments in reading and math served as the Government Performance 
and Results Act (GPRA) measurement for AEMDD grant recipients. For the GPRA, the TEAM program 
utilized the Illinois Standard Achievement Tests (ISAT) which are administered to CPS students each 
spring to assess their proficiency in reading and math. The schools participating in TEAM were matched 
with non-participating schools that were similar with respect to prior ISAT achievement, ethnicity, and 
poverty. The results of analyses carried out on reading and math achievement tests showed that TEAM 
students’ performance on both reading and math was higher than that of students in the comparison 
schools. The 2012, 2013, and 2014 ISAT reading and math results were statistically significant. The 
difference between TEAM and comparison students meeting or exceeding proficiency in reading ranged 
from 4 to 18 percentage points (see Figure 2). The math difference ranged from 3 to 30 percentage points 
(see Figure 3). It should be noted that new cut scores were introduced for the 2013 test administration 
and the percent of students meeting or exceeding proficiency in 2013 and 2014 was considerably lower 
than in the preceding two years. Additional details regarding performance on the ISAT assessments are 
provided in Appendix G. 


% Meets or Exceeds Proficiency on ISAT Reading 
90% 
¥ 78% 
” 76% = 
72% 71% 
70% 
60% 57% 
55% 

Fe 50% 
5 44% 
g 

40% 37% 

30% 

20% 

10% 

0% 

2011 2012 2013 2014 
m@TEAM Comparison 


Figure 2. Percent of TEAM Students and Comparison Students Meeting or Exceeding Proficiency on the 
ISAT Reading, 2011 to 2014. 
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30% 


20% 


10% 


0% 


81% 


2011 


78% 


% Meets or Exceeds Proficiency on ISAT Math 


TEAM ®& Comparison 


Figure 3. Percent of TEAM Students and Comparison Students Meeting or Exceeding Proficiency on the 
ISAT Math, 2011 to 2014. 


Center for Applied Research and Educational Improvement 


University of Minnesota 


17 


Results of Surveys Administered to Teachers in 
TEAM Program Years (Years 2 to 4) 


Classroom teachers participating in TEAM completed pre- and post-residency surveys where they were 
asked questions about their use of technology and media arts integration in the classroom, their students’ 
growth in media skills, their opinions about working with a TEAM teaching artist, and their level of 
involvement with planning and implementing the arts integrated unit in their classrooms. The number of 
teachers responding to the questionnaires ranged from 8 to 22. Because the sample sizes were very small, 
no inferential statistical significance tests were applied to the data. Results are summarized in terms of 
descriptive statistics. 


¢ Teachers’ Perceptions of Growth in Their Students’ Media Skills 


On the post-residency surveys, teachers were asked to indicate the level of growth they observed in their 
students’ media skills in four areas: a) Becoming a critical consumer of media, b) Using media to connect 
with external resources and people, c) Using media to collaborate with other students, and d) Using media 
to create original works of art. These four areas and the percent of teachers responding moderate level of 
growth or high level of growth are shown below. 


e Becoming a Critical Consumer of Media (% Responding Moderate or High Level of Growth) 
=" Year 2 (2012): Post-residency = 64% 
" Year 3 (2013): Post-residency = 84% 
=" Year 4 (2014): Post-residency = 88% 


e Using Media to Connect with External Resources and People (% Responding Moderate or 
High Level of Growth) 
=" Year 2 (2012): Post-residency = 79% 
" Year 3 (2013): Post-residency = 74% 
" Year 4 (2014): Post-residency = 88% 


e Using Media to Collaborate with Other Students (% Responding Moderate or High Level of 
Growth) 
=" Year 2 (2012): Post-residency = 85% 
" Year 3 (2013): Post-residency = 84% 
" Year 4 (2014): Post-residency = 88% 


e Using Media to Create Original Works of Art (Music, Photography, Graphic Design, 
Videos, etc.) (Y% Responding Moderate or High Level of Growth) 
=" Year 2 (2012): Post-residency = 73% 
" Year 3 (2013): Post-residency = 79% 
=" Year 4 (2014): Post-residency = 100% 


The year 4 results are especially impressive. Eighty-eight percent of year 4 teachers said their students 
experienced a moderate or high level of growth in becoming a critical consumer of media, using media to 
connect with external resources and people, and using media to collaborate with other students. All year 
4 respondents (100%) said their students experienced a moderate or high level of growth in using media 
to create original works of art. 
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¢ Teachers’ Use of Technology and Media Arts Integration in Their Classrooms 


Teachers’ responses to questions concerning their use of technology and media arts integration in their 
classrooms indicated that pre-residency use of technology was greater than pre-residency use of media 
arts. However, both technology and media arts integration showed pre- to post-residency increases. 
Results by year are shown below in terms of the percent responding some or a great deal on the pre- 
residency survey compared to the post-residency survey. 


"In general, how much do you use technology in your classroom? (% Responding Some or a 
Great Deal) 
" Year 2 (2012): Pre-residency = 64%, Post-residency = 87% 
" Year 3 (2013): Pre-residency = 89%, Post-residency = 91% 
" Year 4 (2014): Pre-residency = 88%, Post-residency = 100% 


e In general, how much do you use media arts in your classroom? (% Responding Some or a 
Great Deal) 
=" Year 2 (2012): Pre-residency = 29%, Post-residency = 40% 
" Year 3 (2013): Pre-residency = 61%, Post-residency = 68% 
" Year 4 (2014): Pre-residency = 68%, Post-residency = 100% 


The post-residency percentages increased very consistently from one year to the next, indicating that 
teachers who participated in all years were likely increasing their knowledge and skills related to 
technology and media arts integration. 


¢ Impact of TEAM on Teachers’ Ability to Create Curriculum Integrating the Arts and 
Technology (APR Performance Measure 2.3) 


Performance Measure 2.3: Target on Status Form of Annual Performance Report: By June, 2011: 30% 
of teachers will be able to collaborate with teaching artists in classrooms in creating curriculum 
integrating the arts and technology (as self-reported on a yearly survey). June, 2012: 60% of teachers 
will be able to collaborate with teaching artists in classrooms in creating curriculum integrating the 
arts and technology. June, 2013: 80% of teachers will be able to collaborate with teaching artists in 
classrooms in creating curriculum integrating the arts and technology. June, 2014: 90% of teachers 
will be able to collaborate with teaching artists in classrooms in creating curriculum integrating the 
arts and technology. 


Performance measure 2.3, displayed above, dealt with the teaching artist-classroom teacher partnership 
and teachers being able to create curriculum integrating the arts and technology. Attainment of the 
performance target was assessed by a survey item that stated I am able to effectively collaborate with a 
teaching artist in my classroom to create curriculum that integrates media arts and technology. Teachers 
responded using a four-point agreement scale: Strongly disagree, disagree, agree, and strongly disagree. 
The results are shown below. 


e Tam able to effectively collaborate with a teaching artist in my classroom to create 
curriculum that integrates media arts and technology. (% Agreeing) 
=" Year 2 (2012): Post-residency = 85% 
" Year 3 (2013): Post-residency = 95% 
" Year 4 (2014): Post-residency = 100% 
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The results were extremely positively. The percent of TEAM teachers indicating they were able to 
effectively collaborate with a teaching artist to create curriculum that integrated media arts and 
technology increased from 85% in year 2 to 100% in year 4. Furthermore, each year, the annual 
performance target was exceeded by 10 to 15 percentage points. 


¢ Impact of TEAM on Teachers’ Capacity to Use Integrated Media Arts and Technology 
Instruction Outside the Residency (APR Performance Measure 2.4) 


Performance Measure 2.4: Target on Status Form of Annual Performance Report: June, 2011: 30% of 
7" grade teachers will be able to continue the use of integrated arts and technology instruction 
(outside of the residency). June, 2012: 60% of teachers will be able to continue the use of integrated 
arts and technology instruction. June, 2013: 80% of teachers will be able to continue the use of 
integrated arts and technology instruction. June, 2014: 90% of teachers will be able to continue the 
use of integrated arts and technology instruction. 


Performance measure 2.4, shown above, concemed the teachers’ ability to continue use of media arts and 
technology in their classrooms outside of the residency. Attainment of the performance measure was 
assessed directly by a survey item that stated The teacher-teaching artist partnership has helped me 
improve my ability to use media arts and technology in the classroom. Across TEAM’s three program 
years, 25 out of 29 unique teachers (86%) agreed that the partnership improved their ability to use media 
arts and technology in the classroom. Results for this item are summarized below by the agreement rate 
attained in each program year. 


e The teacher-teaching artist partnership has helped me improve my ability to use media arts 
and technology in the classroom. (% Agreeing) 
=" Year 2 (2012): Post-residency = 79% 
" Year 3 (2013): Post-residency = 80% 
" Year 4 (2014): Post-residency = 100% 


As an additional assessment of capacity, teachers were asked if they implemented concepts or activities 
from the TEAM project in any of their classes when the teaching artist was not there. Across TEAM’s 
three program years, 23 out of 29 unique teachers (79%) indicated that they implemented TEAM concepts 
or activities on their own. Survey results are summarized below by the agreement rate attained in each 
program year. 


e Did you implement, on your own, concepts or activities from the TEAM project? 
(% Agreeing) 
" Year 2 (2012): Post-residency = 86% 
" Year 3 (2013): Post-residency = 70% 
=" Year 4 (2014): Post residency = 100% 


The teachers were also asked whether or not the teacher-teaching artist partnership, in general, helped to 
improve their teaching. The agreement rates for this item are displayed below. 


e The teacher-teaching artist partnership has improved my teaching. 
" Year 2 (2012): Post-residency = 79% 
" Year 3 (2013): Post-residency = 70% 
=" Year 4 (2014): Post-residency = 100% 
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In summary, across TEAM’s three program years, 86% of participating classroom teachers indicated that 
the partnership helped to improve their ability to use media arts and technology in the classroom. In 
addition, 79% of participating teachers implemented TEAM concepts or activities on their own when the 
teaching artist was not there. Although these cumulative results fell short of the 90% targeted for year 4, 
the non-cumulative results for year 4 were very impressive. Namely, in TEAM’s fourth and final year, 
100% of teachers agreed that the partnership improved their ability to integrate media arts and technology 
into their classroom practice, and 100% stated that they implemented TEAM concepts or activities on 
their own outside of the residency. 


@ Teachers’ Level of Involvement 


An important goal of the TEAM project was to equip the participating classroom teachers with the 
knowledge and skills they would need in order for them to integrate media arts into their classroom 
practice on their own after the teaching artist residencies ended. Consequently, the questionnaire included 
items regarding the classroom teachers’ level of involvement during the residency and their desired level 
of involvement. The purpose was to assess teachers’ willingness to take on a leadership role in their 
schools regarding media arts integration. 


In each program year, the majority of teachers indicated they were co-teaching with the teaching artist 
(see below) rather than just observing, following along, or doing things not related to the lesson. 


e When the teaching artist was in your classroom, what was your typical level of involvement 
in the lesson? (Percent responding “Co-teaching with the teaching artist”) 
=" Year 2 (2012) Post-residency = 57% 
" Year 3 (2013) Post-residency = 60% 
" Year 4 (2014) Post-residency = 75% 


In each program year, the typical response regarding involvement in creation of the project plan was that 
the classroom teacher and teaching artist contributed equally. More specifically, most teachers indicated 
that both they and the teaching artist were responsible for the shape and scope of the media arts 
integration project and that both contributed ideas. 


If the teachers were to do another TEAM residency, the largest percent each year (40% to 80%) indicated 
they would like the same level of involvement. However, in two of the program years, 25% indicated that 
they wanted to be more involved. They not only wanted to increase integration of media and technology 
in their own teaching practice but also indicated an interest in helping other educators transform their 
practice. The percent selecting the More involvement response in years 2 to 4 is shown below. 


e If you were to do a residency with TEAM again, what level of involvement would you like to 
have? (% responding “More involvement. I’d like to increase the integration of media and 
technology in my teaching practice and/or I'd like to help other educators transform their 
practice.”) 
=" Year 2 (2012) Post-Residency = 25% 

" Year 3 (2013) Post-Residency = 5% 
=" Year 4 (2014) Post-Residency = 25% 
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Strategies to Increase Teacher Capacity 


A challenge encountered by the TEAM project was increasing the teachers’ knowledge and skills related 
to media arts integration given the classroom teachers’ numerous responsibilities and very busy 
schedules. Strategies employed by the TEAM staff included offering flexible residency schedules, 
scheduling professional development sessions at the participating schools, creating a fellowship program, 
and developing a website of resources. 


¢ Flexible Residency Schedules 


In designing the schedule for the residencies, the TEAM staff took many factors into account, such as the 
school’s academic calendar, the class meeting time, and the availability of the artist. In addition, TEAM 
staff found that student engagement seemed best when residencies met at least 90 minutes per class 
period. Before students could become actively engaged in learning activities, equipment often needed to 
be set up and introductory instructions provided. Thus, classes that lasted less than 90 minutes often did 
not provide sufficient time for students to complete meaningful instruction units. 


TEAM designed and redesigned the residencies to provide the best learning conditions as well as to fit in 
with the environment of each participating classroom. Typically, residency classes were scheduled once a 
week for 90 minutes over a period of 14 weeks. However, not all project schools were able to 
accommodate 90 minutes of focused class time. Therefore, TEAM encouraged flexible scheduling of 
residency classes. For example, some residency classes met over a longer periods than 14 weeks and 
others met for shorter periods but multiple times per week. 


At one school, to accommodate the rigorous testing schedule, residencies were created that met 2 hours 
every day for 2 consecutive weeks. In another residency, the teaching artist met with the students for 2 
hours every day for a week, returning a month later for an additional week of classes that met every day 
for 2 hours. In all residencies, the total time that a class met with the teaching artist ranged from 12 to 20 
hours. 


Based on feedback from teachers and teaching artists and observations made during residency classes, 
TEAM staff concluded that the most effective residencies met twice a week in class sessions that lasted at 
least 90 minutes but no more than 120 minutes. Also, it seemed that the maximum effective length of a 
residency was 10 weeks, since residencies that met for periods longer than 10 weeks seemed to drag on 
for the students and they became disengaged with the project. 
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¢ Professional Development Sessions Held at the Participating Schools 


Initially, professional development sessions for participating classroom teachers were held at Columbia 
College in downtown Chicago. Both classroom teachers and teaching artists attended the lessons, the 
teachers were paid a stipend, and sessions that took place over meal times included complete meals. 
Attendance was fairly high at professional development sessions held near the beginning of the school 
year and feedback from participants was very positive. However, attendance dropped off significantly at 
midyear, with many teachers stating that the commute from their school to downtown Chicago was a 
major drawback. Therefore, TEAM began offering professional development at the participating schools. 
Each session was led by CCAP staff and was attended by teachers and administrators from only one 
school. These sessions were essentially coaching sessions where CCAP staff would assist teachers and 
administrators to collaboratively create learning plans for the arts integration residencies. 


¢ Fellowship Program 


TEAM created a fellowship program for classroom teachers and teaching artists that was designed to 
encourage expertise on the part of the participating teachers. The fellowship program was implemented 
in years 3 and 4 with a total of 12 fellows, 7 of whom were classroom teachers. All fellows were required 
to present at professional development sessions held at the schools and also at local or national 
conferences. All 12 fellows presented at a CCAP-wide professional development session, and 9 
presented at local and/or national conferences. Some of the presentations were given by teacher-artist 
pairs. TEAM staff considered the fellowship program to be highly effectively for increasing teachers’ 
capacity to integrate media arts in their classroom practice, not only for the fellows but also for the 
teachers who participated in the professional development sessions offered by the fellows. 


@ Website 


TEAM staff are currently developing a website that will be a curriculum repository. TEAM teachers have 
been invited to share their lesson plans and curriculum units, and all teachers who contribute materials 
will be given authorship credit. In addition, TEAM is using the website to support and encourage a 
professional learning network. Anyone will be able to access these resources. 


Summary and Conclusions 


The four-year evaluation of TEAM identified numerous successes with respect to benefits received by the 
participating seventh- and eighth-grade students and their teachers. The following list presents eight 
highlights of the TEAM project. 


1. Eighty percent or more of students participating in TEAM said that working with a TEAM artist 
in their classes helped them to be more interested and actively involved and to learn the academic 
material better than they would have without TEAM. In addition, 74% or more said they were 
more enthusiastic about attending school on days when the TEAM artist was going to be there 
than on other days. 


2. Although students gave fairly high ratings to their computer skills prior to participating in TEAM, 
a comparison of pre- and post-residency ratings revealed notable increases. In TEAM’s first 
implementation year, increases in six of seven skill ratings were statistically significant. These 
six skills and the percent of students rating themselves as intermediate or expert pre-residency 
compared to post-residency are shown below. 


Center for Applied Research and Educational Improvement 23 
University of Minnesota 


Download and install software from the Internet (35% to 40%) 

Upload or edit photos, videos, and sound (34% to 45%) 

Insert photos, videos, and sound in class presentations (14% to 66%) 

Use tools like spell check, calculator, and thesaurus (89% to 93%) 

Use Google Maps to find information about a neighborhood (76% to 84%) 
Use Excel to make a data base (32% to 43%) 


3. Students’ survey responses indicated that they became more cautious and discerning as 
consumers of media. For example, in TEAM’s fourth year, 20% of students indicated on the pre- 
residency survey that they only visited websites they knew were safe as compared to 83% on the 
post-residency survey, an increase of 63 percentage points. 


4. Students benefited with respect to enhanced critical thinking skills. Statistically significant 
increases were noted in students’ being able to recognize prejudice or bias in media (78% to 90%) 
and paying attention to how people of their age, ethnicity, and gender are represented in movies, 
TV shows, and magazines (76% to 86%). 


5. Students became significantly more confident in sharing their work with others. In TEAM’s first 
program year, the percent of students stating they were confident in sharing their original creative 
work with classmates increased from 65% to 76%. The percent stating they were confident in 
sharing their work with a larger audience online increased from 51% to 63%. 


6. The majority of teachers participating in TEAM indicated that their students became more 
proficient in the areas emphasized by TEAM. These four areas and the average percent of 
teachers saying their students experienced a moderate or high level of growth are listed below. 

e Being a critical consumer of media — 79% 
e Collaborating with other students — 86% 

e Creating original works of art — 84% 

e Connecting with external resources — 80% 


7. Positive results were obtained regarding teacher capacity and the teaching artist/teacher 
collaboration. Averaged across the three program years, the results are as follows: 

e 93% of teachers agreed that they were able to effectively collaborate with a teaching 
artist in their classrooms to create curriculum that integrates media arts and technology. 

e 86% agreed that the teacher-teaching artist partnership helped them to improve their 
ability to use media arts and technology in the classroom. 

e 85% reported that they implemented, on their own, concepts or activities from the TEAM 
project. 


8. The results of analyses on reading and math achievement tests showed that TEAM students’ 
performance on both ISAT reading and ISAT math was significantly higher than that of students 
enrolled in non-participating comparison schools. The TEAM versus comparison group 
difference in the percent meeting or exceeding proficiency in reading across three years ranged 
from 4 to 11 percentage points. The difference in the percent meeting or exceeding proficiency in 
math ranged from 3 to 13 percentage points. 


In addition to successes, TEAM also encountered challenges, particularly with respect to the goal of 
increasing teacher capacity. To meet this challenge, TEAM utilized several strategies to enhance teacher 
involvement and learning. The strategy of flexible scheduling enabled staff to identify the most effective 
timeframes for residency classes, and the fellowship program led to several teachers becoming experts 
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and serving as presenters at professional development sessions as well as at local and national 
conferences. 


At the heart of TEAM’s success is the power of digital media to reimagine and redefine curricula, and the 
classroom teacher plays an extremely important role in activating this power. Through its developmental, 
adaptable program approach, TEAM was able to identify and implement strategies that created 

opportunities for all teachers to increase their capacity and to share their skills and knowledge with others. 


Center for Applied Research and Educational Improvement 25 
University of Minnesota 


Appendix A: Demographic Information about Schools Participating in TEAM 


Appendix A 


Table A-1. 2013-14 school-year Data for Schools Participating in TEAM 


% Meets and 
School Reena Exceeds All % Low % % % of 
Ye a ISAT- Income White Black Hispanic Asian 
< Tested Subjects 

Ses DHEA CateMyeroueutaty 2,3,4 43.4% 98.7% 0.0% | 96.9% 2.4% 0.0% 
Gray Elementary School (PK-8) 1, 2,3,4 99.6% 92.1% 11.2% 1.1% 84.5% 2.2% 
Haines Elementary School (PK-8) 1, 2,3,4 73.9% 94.2% 0.1% 12.6% 1.6% 83.9% 
eae ea Soy 23 39.8% 95.2% 0.0% | 97.9% 1.%1 0.0% 
oe a ae dB 0 May Elementary was closed in 2013 so there were no data for the 2013-14 school year. 


Note: 2013-14 school year data were obtained from the Illinois Interactive Report Card. 
*Year 1 (pilot) = 2010-11, year 2 = 2011-12, year 3 = 2012-13, year 4 = 2013-14 
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Welcome to the TEAM Survey! 

Transforming Education Through the Arts and Media (TEAM) 

The purpose of this survey is to help Project TEAM staff determine how effective Project TEAM is in supporting media 
arts integration and how Project TEAM might be improved. The information you provide on this survey will help Project 
TEAM understand the kinds of support teachers need to continually deepen their work with students, artists, and media 
arts integration. This survey is being administered by the University of Minnesota under a contract with the Center for 
Community Arts Partnerships, Columbia College Chicago. Your individual survey responses will be kept strictly 
confidential. Although we ask for your name, we do so only to match your responses to surveys completed at different 
times. At no time will your individual responses appear in any of the reports on this study. If you have any questions 
about the content of this survey or how we will maintain the confidentiality of your responses, please contact: Beverly 
Dretzke, University of Minnesota, at dretz001@umn.edu or 612-624-3805. We thank you in advance for sharing 


Caution: We recommend that you take the survey on a computer and not on a cell phone. Response options might not 
appear correctly on a cell phone. 


* 4. Your name 


* 2. Your school's name 
~ Claremont 
Gray 
Haines 
Kellman 


Leland 


3. How many years have you taught at this school, including the current year? 
eee eee 


4. What grades do you teach? Check all that apply. 


Grades 


NATIONAL EDUCATION TECHNOLOGY STANDARDS 
Please rate your familiarity with and use of the National Education Technology Standards (NETS). 


5. How familiar are you with the National Education Technology Standards (NETS)? 
~ Not at alll familiar 
~ Somewhat familiar 
~ Moderately familiar 


~ Very familiar 


Page 1 


Center for Applied Research and Educational Improvement 27 
University of Minnesota 


Appendix B: Teacher Pre-Residency Survey 


6. How much have you used NETS in planning for your classes? 


Never 
Very iittie 
Some 


A great deal 


In general, how much do you use technology and media arts integration In your classroom? 
7. Technology 
~ Never 
Very littie 
Some 


A great deal 


8. Media arts integration 


Never 
Very littie 
Some 


A great deal 


9. How would you rate your skill level in integrating media arts into your classroom 
lessons? 


No experience 

Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 
Expert (I could teach others now to do this) 


We would like to Know your skill level related to specific types of media arts. For each type of media arts, please rate your current skill level. 


10. How would you rate your skill level in AUDIO PRODUCTION (microphones, mixers, 4- 
track, podcasting, Garage Band, Logic Studio, Sound Forge, etc.)? 

No experience 

Basic (I can do this but might need assistance) 

Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 
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11. How would you rate your skill level in DIGITAL PHOTOGRAPHY (Digital camera, iPhoto, 
Aperture, Photoscape, Picasa, etc.)? 

"No experience 

"Basic (I can do this but might need assistance} 

~ Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


12. How would you rate your skill level in VIDEO PRODUCTION (Camcorders, Flip Cams, 
Final Cut, Vegas, iMovie, Premier, Movie Maker, etc.)? 

_ No experience 

‘Basic (I can do this but might need assistance) 

"Intermediate (I'm pretty comfortable doing this on my own) 


~ Expert (I could teacn others now to do this) 


13. How would you rate your skill level in GRAPHIC DESIGN (Scanners, Photoshop, 
Illustrator, PowerPoint, etc.)? 


"NO experience 
Basic (I can do this but might need assistance) 
"Intermediate (I'm pretty comfortable doing this on my own) 


~ Expert (I could teach others now to do this) 


14. How would you rate your skill level in ANIMATION/SIMULATION (After Effects, Alice, 
Anime Studio, Cheetah, etc.)? 

"No experience 

"Basic (I can do this but might need assistance) 

Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


15. How would you rate your skill level in GAME DESIGN (Alice, GameStar Mechanic, 
Scratch, etc.)? 


"No experience 
‘Basic (I can do this but might need assistance) 
"Intermediate (I'm pretty comfortable doing this on my own) 


~ Expert (I could teacn others now to do this) 
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16. How would you rate your skill level in SOCIAL MEDIA (Facebook, Twitter, Blogging, 
etc.)? 


No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


17. Please give us a specific example of how you've integrated media arts into your 
curriculum. Your example might be a project, a unit, or a lesson. 


Gg 


HOW STUDENTS USE TECHNOLOGY AND MEDIA IN YOUR CLASSROOM 
How often do your students use technology and media In your classroom related to the following skilis? 


18. Learn about current events 
Never 
Rarely (1 or 2 times per year) 
Quarterly (or about 4 times per year) 
Monthly (or about 6-10 times per year) 


Weekly 


Dally 


19. Collaborate with other students 
Never 
Rarely (1 or 2 times per year) 
Quarterly (or about 4 times per year) 
Monthty (or about 6-10 times per year) 


Weekly 
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20. Create original works of art (music, photography, graphic design, videos, etc.) 
~ Never 
Rarely (1 of 2 times per year) 
Quarterly (or about 4 times per year) 
Monthly (or about 8-10 times per year) 


Weekly 


Daily 


21. Publish work to be read or seen by an audience outside the school community, 
including YouTube/Vimeo, blogs, Twitter, etc. 
"Never 
Rarely (1 of 2 times per year) 
Quarterly (or about 4 times per year) 
Monthly (or about 8-10 times per year) 
Weekly 
Daily 
COMMUNICATING WITH TECHNOLOGY 


Several types of technology are listed below. For each type, indicate if you use It to communicate with students, parents, fellow teachers, and/or 
your extended professional network. If you don’t use the technology with any of these groups, please select "Don't use It with any of these groups.” 


22. Video tutorials, podcasts, or screencasts (select all that apply) 


Fellow teachers and other colleagues at my schoo! 
My extended professional network of other educators and practitioners 


Dont use It with any of these groups 


23. Diigo.com or other social bookmarking sites (select all that apply) 


Fellow teachers and other colleagues at my schoo! 
My extended professional network of other educators and practitioners 


Dont use It with any of these groups 
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24. Blog (select all that apply) 
~ Students 
Parents 
Fellow teachers and other colleagues at my schoo! 
My extended professional network of other educators and practitioners 


Dont use It with any of these groups 


25. Facebook, MySpace, Twitter or other social networking site (select all that apply) 
Students 
Parents 
Fellow teachers and other colleagues at my schoo! 
My extended professionai network of other educators and practitioners 


Dont use It with any of these groups 


26. Wiki pages (select all that apply) 
Students 
Parents 
Fellow teachers and other colleagues at my schoo! 
My extended professional network of other educators and practitioners 


~ Dont use It with any of these groups 


SUPPORT FOR USING TECHNOLOGY AND MEDIA ARTS IN YOUR CLASSES 
How satisfied are you with the following? 


27. Professional development you have received for integrating media arts in your 
teaching 


Very dissatisfied Very satistied 


28. Your school's commitment to technology in the classroom 


Very dissatisfied Dissats‘ied Neutral Satisfied Very satisfied 


29. What other types of support would you like for integrating technology use in your 


ao 
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30. How often do you reflect on your teaching practice? 
~ Never 
Yearly 
Quarterly 
Monthly 
Weekly 


Daily 


31. How often do you collaborate with other educators? 
"Never 
Yearly 
Quarterly 
Monthly 
Weekly 


Dally 


32. Please use the space below for any other thoughts or comments you'd like to share 
about the approach to technology in your school. 


nanan) 


Thank you for completing this survey! 


Center for Applied Research and Educational Improvement 33 
University of Minnesota 


Appendix C: Teacher Post-Residency Survey 


Welcome to the TEAM Survey! 
Transforming Education Through the Arts and Media (TEAM) 


The purpose of this survey is to help Project TEAM staff determine how effective Project TEAM is in supporting media 
arts integration and how Project TEAM might be improved. The information you provide on this survey will help Project 
TEAM understand the kinds of support teachers need to continually deepen their work with students, artists, and media 
arts integration. This survey is being administered by the University of Minnesota under a contract with the Center for 
Community Arts Partnerships, Columbia College Chicago. Your individual survey responses will be kept strictly 
confidential. Although we ask for your name, we do so only to match your responses to surveys completed at different 
times. At no time will your individual responses appear in any of the reports on this study. If you have any questions 
about the content of this survey or how we will maintain the confidentiality of your responses, please contact: Beverly 
Dretzke, University of Minnesota, at dretz001@umn.edu or 612-624-3805. We thank you in advance for sharing 
information with us. 


Caution: We recommend that you take the survey on a computer and not on a cell phone. Response options might not 
appear correctly on a cell phone. 


* 4. Your name 


* 2. Your school's name 
~ Claremont 
cay 
Haines 


~ Kellman 


~ Leland 


3. How many years have you taught at this school, including the current year? 
eS Sl 


4. What grades do you teach? Check all that apply. 


NATIONAL EDUCATION TECHNOLOGY STANDARDS 
Please rate your tamiltarity with and use of the National Education Technology Standards (NETS). 


5. How familiar are you with the National Education Technology Standards (NETS)? 
~ Not at all familiar 
Somewhat familiar 
Moderately familiar 


Very familiar 
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6. How much have you used NETS in planning for your classes? 
Never 
"Very ilttie 
Some 


_ Agreat deal 


In general, how much do you use technology and media arts integration In your classroom? 
7. Technology 
"Never 
Very ilttie 
Some 


A great deal 


8. Media arts integration 


Never 
Very ittie 
Some 


A great deal 


YOUR MEDIA ARTS SKILLS 
We would like to know your s&ill level In media ars. For each type of media arts, please rate your current skill level. 


9. How would you rate your skill level in AUDIO PRODUCTION (microphones, mixers, 4- 
track, podcasting, Garage Band, Logic Studio, Sound Forge, etc.)? 

No experience 

Basic (I can do this but might need assistance) 

Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


10. How would you rate your skill level in DIGITAL PHOTOGRAPHY (Digital camera, iPhoto, 
Aperture, Photoscape, Picasa, etc.)? 

No experience 

Basic (I can do this but might need assistance) 

Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 
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11. How would you rate your skill level in VIDEO PRODUCTION (Camcorders, Flip Cams, 
Final Cut, Vegas, iMovie, Premier, Movie Maker, etc.)? 
No experience 
"Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


12. How would you rate your skill level in GRAPHIC DESIGN (Scanners, Photoshop, 
Illustrator, PowerPoint, etc.)? 


No experience 
~ Basic (I can do thts but might need assistance) 
Intermediate (I'm pretty comfortadle doing this on my own) 


Expert (I could teach others now to do this) 


13. How would you rate your skill level in ANIMATION/SIMULATION (After Effects, Alice, 
Anime Studio, Cheetah, etc.)? 
No experience 
‘Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


14. How would you rate your skill level in GAME DESIGN (Alice, GameStar Mechanic, 
Scratch, etc.)? 


No experience 
"Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


15. How would you rate your skill level in SOCIAL MEDIA (Facebook, Twitter, Blogging, 
etc.)? 

No experience 

Basic (I can do this but might need assistance) 

Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 
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16. Please give us a specific example of how you've integrated media arts into your 
curriculum. Your example might be a project, a unit, or a lesson. 


a 


> 


HOW STUDENTS USE TECHNOLOGY AND MEDIA IN YOUR CLASSROOM 
How often do your students use technology and media In your classroom reiated to the following skilis? 


17. Learn about current events 
Never 
Rarely (1 or 2 times per year) 
Quarterly (or about 4 times per year) 
Monthly (or about 8-10 times per year) 
Weekly 


Daily 


18. Collaborate with other students 
Never 
Rarely (1 of 2 times per year) 
Quarterly (or about 4 times per year) 
Monthly (or about 6-10 times per year) 


Weekly 


Dally 


19. Create original works of art (music, photography, graphic design, videos, etc.) 


Never 

Rarely (1 of 2 times per year) 
Quarterly (or about 4 times per year) 
Monthty (or about 8-10 times per year) 


Weekly 
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20. Publish work to be read or seen by an audience outside the school community, 
including YouTube/Vimeo, blogs, Twitter, etc. 
"Never 
Rarely (1 of 2 times per year) 
Quarterty (or about 4 times per year) 


Monthty (or about 8-10 times per year) 


weekly 


Daily 


GROWTH IN YOUR STUDENTS’ MEDIA SKILLS 

As a result of participation In the TEAM project, what level of growth have you seen in your students’ media skilis this year in the areas of 
consumption, connection, collaboration, and creation? Use the rating scale shown below. Please select Don’t know If you have no basis to 
provide a skill level rating. 

No growth 

Low level of growth 

Moderate level of growth 

High level of growth 

Dont know 


21. Becoming a critical consumer of media 


No growth Low level of growth Moderate level of growth High level of growth 


22. Using media to connect with external resources and people 


No growth Low level of growth Moderate level of growth High level of growth 


23. Using media to collaborate with other students 


No growth Low level of growth Moderate level of growth High level of growth Don't Know 


24. Using media to create original works of art (music, photography, graphic design, 
videos, etc.) 
No growth Low level of growth Moderate level of growth High level of growth Don't Know 


WORKING WITH A TEACHING ARTIST 


The items In this section concern your experience working with a teaching artist In your classroom this school year. Please Indicate the extent to 
which you agree or disagree with each statement. 


25.1 am able to effectively collaborate with a teaching artist in my classroom to create 
curriculum that integrates media arts and technology. 
Strongly disagree Disagree Agree Strongly agree 
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26. The teacher-teaching artist partnership has helped me improve my ability to use media 
arts and technology in the classroom. 
Strongly disagree Disagree Agree Strongly agree 


27. The teacher-teaching artist partnership has improved my teaching. 
Strongly disagree Disagree Agree Strongly agree 


28. I have the ability to continue the use of integrated arts and technology instruction on 
my own without having a teaching artist in my classroom. 
Strongly — = — a agree 


29. When the teaching artist was in your classroom, what was your typical level of 
involvement in the lesson? (select only one) 


1 was neither observing nor participating (¢.g.. Doing things not related to the teaching artist's lesson such a5 marking papers for 
another class). 


| was observing (¢.9.. ODserving and following along but not actively participating in the lesson). 
Ll was supporting the teaching artist (2.9.. Following along and handing out materials, but not teaching any content). 
I was co-teaching with the teaching artist (2.9.. Giving instructions to the entire class or providing connections or assistance for 
Individual students ). 
30. In which of your classes did you implement, on your own, concepts or activities from 
the project? (check all that apply) 
~ None 
In the residency class on days when the teaching artist wasn’t there 


~ Inmy other classes 


‘Other, please specity 


eee 


31. When the teaching artist was in your classroom, what was your typical level of 
involvement in managing students’ behavior? (select only one) 

| was not Involved. The teaching artist was responsible for management of students” behavior. 

| shared responsibility for managing students’ behavior with the teaching artist. 


| was responsible for management of students’ behavior. The teaching artist was not Involved. 
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32. What was your level of involvement in creating the plan for the arts integrated unit 
implemented in your classroom? (select only one) 

| contributed a few ideas, but the artist was responsible for the shape and scope of the project. 

The artist and | contributed equally to the creation of the plan for the project. 


The artist contributed a few ideas, but | was responsible for the shape and scope of the project. 


33. How often did you and the artist typically communicate during the residency? (select 
only one) 

infrequently, less than once 2 week 

Once a week, during class time for the residency 

Once a week, before and/or after class time 

A couple of times during the week, Doth on residency class days and also between classes via email, phone, or text 


More than two times per week 


34. If you were to do a residency with TEAM again, what level of involvement would you 
like to have? 


Less Involwement. This project was a greater commitment than | would nave liked. 
Same level of involvement. The level of commitment worked well for me and my students. 


More Involvement. I'd like to Increase the Integration of media and technology In my teaching practice and/or I'd like to help other 
educators transform thelr practice. 


COMMUNICATING WITH TECHNOLOGY 
Several types of technology are listed below. For each type, indicate If you use It to communicate with students, parents, fellow teachers, and/or 
your extended professional network. If you don’t use the technology with any of these groups, please select "Don't use It with any of these groups.” 


35. Video tutorials, podcasts, or screencasts (select all that apply) 


Fellow teachers and other colleagues at my schoo! 
My extended professional network of other educators and practitioners 


Dont use It with any of these groups 


36. Diigo.com or other social bookmarking sites (select all that apply) 


Fellow teachers and other colleagues at my schoo! 
My extended professional network of other educators and practitioners 


Dont use It with any of these groups 
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37. Blog (select all that apply) 
Students 
Parents 
Fellow teachers and other colleagues at my schoo! 
My extended professional network of other educators and practitioners 


Dont use It with any of these groups 


38. Facebook, MySpace, Twitter or other social networking site (select all that apply) 
Students 
Parents 
Fellow teachers and other colleagues at my schoo! 
My extended professional network of other educators and practitioners 


Dont use It with any of these groups 


39. Wiki pages (select all that apply) 
Students 
Parents 
Fellow teachers and other colleagues at my schoo! 
My extended professional network of other educators and practitioners 


"Dont use It with any of these groups 


SUPPORT FOR USING TECHNOLOGY AND MEDIA ARTS IN YOUR CLASSES 
How satisfied are you with the following? 


40. Professional development you have received for integrating media arts in your 
teaching 


Very dissatisfied Very satisfied 


41. Your school's commitment to technology in the classroom 
Very dissatisfied Dissate‘led Neutral Satisfied 


42. What other types of support would you like for integrating technology use in your 
classroom? 


5 
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43. How often do you reflect on your teaching practice? 


Dally 


44. How often do you collaborate with other educators? 


Dally 


45. Please use the space below for any other thoughts or comments you'd like to share 
about the approach to technology in your school. 


] 


Thank you for taking the TEAM survey. 
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Welcome to the TEAM survey! 
Transforming Education Through the Arts and Media (TEAM) 


We are trying to understand what students might leam in Project TEAM. We are asking students to complete a short 
survey at the beginning and at the end of the project. There are no nght or wrong answers to the survey questions. We 
only want to know what you think. No one will see your answers except the researchers who are doing the study for 
Project TEAM. Being in the study is totally up to you and no one will be mad at you if you do not want to do it. Thank 
you for your time. 
* 4. Which school do you attend? 

~ Claremont 

ony 

Haines 


~ Kellman 


~ Leland 


*2. Please type your Project TEAM Survey ID number in the space below: 


—e———e 


* 3. Please type your teacher's last name in the space below: 


: 


* 4. What grade are you in? 
" Grade7 


’ Grades 


The items in this section ask you about how you work and learn, both in school and out of school. Please read each statement and mark the 
answer that best says how much you agree that the description is true for you. 


5. | like school. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


6. | use the things | lear in school in other parts of my life. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


7. When something is difficult, | try different ways to figure it out. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


8. | participate in class discussions. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 
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9. | like solving problems and puzzles. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


10. | make a plan before starting on a big assignment or project. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


11. When I'm curious or confused about something, | ask questions or look up 
information. 
Strongly disagree King of disagree King of agree Strongly agree 


12. When writing a paper or doing a project, | start with a rough draft and then revise it to 
make it better. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


13. When working in a group, | am a leader. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


14. | believe what | lear in school can help me make a difference in my community. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


15. | stay informed on current events, politics, and community issues. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


These statements describe skills related to using computers. How well can you do these things? Please read each statement and mark the 
answer that best describes you. 


16. Use video, sound, or pictures in Power Point or Keynote in presentations for class 
"No experience 
‘Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


17. Use Excel to make a database or solve math problems 
No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 
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18. Upload and edit my own photos, videos, and sound 
No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


19. Download and install software from the Internet 
No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


20. Use Google Maps to find information about a neighborhood or certain location 
No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


21. Use tools like spell check, calculator, dictionary, thesaurus, etc. to help me in my 
learning or work 

No experience 

Basic (I can do this but might need assistance) 

Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


22. Learn how to do something new on a computer, camera, phone, or other device by 
seeing what happens when playing around with it 


No experience 
Basic (I can do this Dut might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this} 


These statements describe skills related to interacting with media. 
How well can you do these things? Please read each statement and mark the answer that best says how much you agree that the 


description is true for you. 
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23. 1 am very picky about what I watch, read, and listen to. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


24. When I'm interested in a topic or issue, I try to get information from a bunch of different 
sources (like TV, radio, the Internet, etc.) to understand it more fully. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


25. When I search for something online and | get thousands of results, I can effectively 
decide which ones will be the most useful for me. 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


26. I follow my favorite books, actors, shows, musicians, etc. across different platforms 
and media (TV, magazines, Internet, Facebook, Twitter, etc.). 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


27. | can recognize prejudice or bias in media (racism, sexism, stereotyping, etc.). 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


28. | can tell whether or not an online information source is reliable and accurate. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


29.1 think about how people of my age, ethnicity, and gender are represented in movies, 
TV shows, and magazines. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


30. | enjoy using things like Wikipedia, team games, online fan communities, and 
community message boards to collaborate and have conversations with people I've never 


met. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


31. I like to share links, videos, and other cool stuff on social media sites like Facebook, 
YouTube, or Twitter. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 
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32. When I can't solve a problem or find a piece of information by myself, | use the Internet 
or social media to connect with others and find what I am looking for. 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


33. When I go online, | feel like | am part of a community. 
Strongly disagree King of disagree Kind of agree Strongly agree 


34. | act, talk, and treat people differently online than | do in person. 
Strongly disagree King of disagree Kind of agree Strongly agree 


35. | only visit websites I know are safe. 
Strongly disagree Kind of disagree Kind of agree 


36. | often comment on articles, photos, or videos online. 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


37.1 can tell stories in different ways, such as through photography, video, writing, 
drawing, etc. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


38.1 can create art or media that represents who | am. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


39. | feel confident sharing my original creative work with my classmates. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


40. I feel confident sharing my original creative work with a larger audience online. 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


41. When making a video or creating an image, | know how to use visual clues to get 
across information about a character, setting, or other concepts (for instance, the type of 
clothing a character wears might tell us about them before they even speak). 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


42. | consider myself a media artist. 
Strongly disagree Kind of disagree Kind of agree 
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Please tell us about your plans for college. 
43. Do you plan to attend college after you finish high school? 
Definitely will attend 
Probably will attend 
Probably will not attend 


Definitely will not attend 


44. What subject or field would you like to study? 


SS 
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Welcome to the TEAM survey! 
Transforming Education Through the Arts and Media (TEAM) 


We are trying to understand what students might leam in Project TEAM. We are asking students to complete a short 
survey at the beginning and at the end of the project. There are no nght or wrong answers to the survey questions. We 
only want to know what you think. No one will see your answers except the researchers who are doing the study for 
Project TEAM. Being in the study is totally up to you and no one will be mad at you if you do not want to do it. Thank 
you for your time. 
* 4. Which school do you attend? 

~ Claremont 

i itis 

Haines 


Kellman 


~ Leland 


*2. Please type your Project TEAM Survey ID number in the space below: 


* 3. Please type your teacher's last name in the space below: 


4 


* 4. What grade are you in? 
- Grade7 


~ Grades 


The items in this section ask you about how you work and learn, both in school and out of school. Please read each statement and mark the 
answer that best says how much you agree that the description is true for you. 


5. | like school. 
Strongly disagree Kind of disagree Kind of agree 


6. | use the things I lear in school in other parts of my life. 
Strongly disagree Kind of disagree Agree 


7. When something is difficult, | try different ways to figure it out. 
Strongly disagree Kind of disagree Kind of agree 


8. | participate in class discussions. 
Strongly disagree Kind of disagree King of agree 


Page 1 
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9. | like solving problems and puzzles. 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


10. | make a plan before starting on a big assignment or project. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


11. When I'm curious or confused about something, | ask questions or look up 
information. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


12. When writing a paper or doing a project, | start with a rough draft and then revise it to 
make it better. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


13. When working in a group, | am a leader. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


14. | believe what | lear in school can help me make a difference in my community. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


15. | stay informed on current events, politics, and community issues. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


These statements describe skills related to using computers. How well can you do these things? Please read each statement and mark the 
answer that best describes you. 


16. Use video, sound, or pictures in Power Point or Keynote in presentations for class 
No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


17. Use Excel to make a database or solve math problems 
No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 
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18. Upload and edit my own photos, videos, and sound 
No experience 
Basic (I can do ths Dut might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


19. Download and install software from the Internet 
No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teacn others now to do this) 


20. Use Google Maps to find information about a neighborhood or certain location 
No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teacn others now to do this) 


21. Use tools like spell check, calculator, dictionary, thesaurus, etc. to help me in my 
learning or work 


No experience 
Basic (I can do this but might need assistance) 
Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


22. Learn how to do something new on a computer, camera, phone, or other device by 
seeing what happens when playing around with it 

No experience 

Basic (I can do this but might need assistance) 

Intermediate (I'm pretty comfortable doing this on my own) 


Expert (I could teach others now to do this) 


These statements describe skills related to interacting with media. 
How well can you do these things? Please read each statement and mark the answer that best says how much you agree that the 


description is true for you. 


Page 3 
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23.1 am very picky about what I watch, read, and listen to. 
Strongly disagree Kind of disagree Kind of agree 


24. When I'm interested in a topic or issue, I try to get information from a bunch of different 


sources (like TV, radio, the Internet, etc.) to understand it more fully. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


25. When I search for something online and | get thousands of results, | can effectively 
decide which ones will be the most useful for me. 
Strongly disagree King of disagree Kind of agree Strongly agree 


26. I follow my favorite books, actors, shows, musicians, etc. across different platforms 


and media (TV, magazines, Internet, Facebook, Twitter, etc.). 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


27. | can recognize prejudice or bias in media (racism, sexism, stereotyping, etc.). 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


28. | can tell whether or not an online information source is reliable and accurate. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


29.1 think about how people of my age, ethnicity, and gender are represented in movies, 
TV shows, and magazines. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


30. 1 enjoy using things like Wikipedia, team games, online fan communities, and 
community message boards to collaborate and have conversations with people I've never 


met. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


31. | like to share links, videos, and other cool stuff on social media sites like Facebook, 
YouTube, or Twitter. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 
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32. When I can't solve a problem or find a piece of information by myself, | use the Internet 
or social media to connect with others and find what I am looking for. 


Strongly disagree Kind of disagree King of agree Strongly agree 


33. When I go online, | feel like | am part of a community. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


34.1 act, talk, and treat people differently online than | do in person. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


35.1 only visit websites | know are safe. 
Strongly disagree Kind of disagree 


36. | often comment on articles, photos, or videos online. 
Strongly disagree Kind of disagree Kind of agree 


37.1 can tell stories in different ways, such as through photography, video writing, 


drawing, etc. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


38.1 can create art or media that represents who | am. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


39. | feel confident sharing my original creative work with my classmates. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


40. I feel confident sharing my original creative work with a larger audience online. 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


41. When making a video or creating an image, | know how to use visual clues to get 
across information about a character, setting, or other concepts (for instance, the type of 
clothing a character wears might tell us about them before they even speak). 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


42.1 consider myself a media artist. 
Strongly disagree Kind of disagree King of agree Strongly agree 
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These statements concern working with a TEAM artist in your class this year. Please read each statement and mark the answer that best 
says how much you agree that the description is true for you. 


43. Working with a TEAM artist from Columbia helped me learn the academic material in 
this class better than | would have without TEAM. 


Strongly disagree King of disagree King of agree Strongly agree 


44. Working with a TEAM artist from Columbia helped me to be more actively involved in 
this class than | would have been without TEAM. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


45. Working with a TEAM artist from Columbia helped me to be more interested in this 
class than I would have been without TEAM. 


Strongly disagree Kind of disagree Kind of agree Strongly agree 


46.1 was more enthusiastic about attending school on days when the TEAM artist from 
Columbia was going to be there than on other days. 
Strongly disagree Kind of disagree Kind of agree Strongly agree 


Please tell us about your plans for college. 
47. Do you plan to attend college after you finish high school? 
Definitely will attend 
Probably will attend 
Probably will not attend 


~ Definitely will not attend 


48. What subject or field would you like to study? 


Thank you for participating in the TEAM survey. 


p age 6 
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Table F-1. Students’ Self-Ratings of Their Computer-Related Skills Including Only Those Students Who Participated in TEAM in Both Grade 7 
and Grade 8 in TEAM Program Years 2 and 3 


Computer-Related Skill 


(Response Scale: No Experience = 1, Basic = 2, Intermediate = 3, Expert = 4) 


Students’ Mean Skill Ratings 


Grade 7 in Year 2 (2011-12) 


Grade 8 in Year 3 (2012-13) 


n Pre Post D n Pre Post D 

Use video, sound, or pictures in 
if : f 2.32 2.80 2.64 2.88 

Power Point or Keynote in 94 (0.85) (0.84) <.001 105 (0.79) (0.76) .002 
presentations for class 
Use Excel to make a database or solve 2.12 2.34 2.13 2.24 

93 ns 106 ns 
math problems (0.92) (0.81) (0.74) (0.78) 
Upload or edit my own photos, 2.96 3.14 3.04 3.26 
videos, and sound. ae (0.92) (0.86) ie aoe (0.85) (0.84) ae 
Download and install software from 9A 2.87 2.98 a 105 3.10 3.22 ss 
the Internet. (1.06) (0.99) (0.92) (0.87) 
ee ee ee lh ae oe ee 

uae (0.88) (0.78) (0.69) (0.73) 

location 
dda hee ek ume ||| tee. ||. | eee ae 106 || (352 | 349 |g 
ms ea (0.71) (0.65) (0.65) (0.65) 
in my learning or work 
Learn how to do something new on a 
computer, camera, phone, or other 94 3.33 3.41 or 107 3.24 3.35 ca 
device by seeing what happens when (0.77) (0.69) (0.76) (0.72) 
playing around with it 
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Appendix F: Summary of Analyses of Survey Responses Given by Students Who Participated in TEAM in Both Grade 7 and Grade 8 


Table F-2. Students’ Behaviors and Skills Related to Consumption of Media Including Only Those Students Who Participated in TEAM in Both 
Grade 7 and Grade 8 in TEAM Program Years 2 and 3 


Behavior or Skill Related to 
Consumption of Media 


Mean Agreement Rating 
(Response Scale: Strongly Disagree = 1, Kind of Disagree = 2, Kind of Agree = 3, Strongly Agree = 4) 


Grade 7 in Year 2 (2011-12) 


Grade 8 in Year 3 (2012-13) 


n Pre Post Dp n Pre Post D 
I am very picky about what I watch 92 2.92 2.92 2 106 3.06 3.01 i 
read, and listen to. (0.88) (0.87) (0.84) (0.79) 
When I’m interested in a topic or 
issue, I try to get information from a 
bunch of different sources (like TV, 93 es 65) ns 107 hes oon ns 
radio, the Internet, etc.) to understand : , : 
it more fully. 
When I search for something online 
and I get thousands of results, I can 90 3.21 3.26 fe 105 3.28 3.30 ae 
effectively decide which ones will be (0.80) (0.74) (0.69) (0.63) 
the most useful for me. 
I follow my favorite books, actors, 
shows, musicians, etc. across different 92 3.24 3.24 ne 107 3.27 3.29 a 
platforms and media (TV, magazines, (0.86) (0.80) (0.80) (0.69) 
Internet, Facebook, Twitter, etc.). 
I can recognize prejudice or bias in 3.05 3.29 3.26 3.23 
media (racism, sexism, etc.). Me (0.93) (0.74) ee ae (0.74) (0.68) a 
enn a ‘critic 7s 91 ou =P ns 107 eee aa ns 
(0.78) (0.60) (0.67) (0.57) 
accurate. 
I think about how people my age, 3.00 3.10 7.95 7.98 
ethnicity, and gender are represented 91 (0.72) (0.62) ns 104 (0.76) (0.62) ns 
in movies, TV shows, and magazines. , : : , 
I only visit websites I know are safe. 93 3.22 3.10 a 107 3.20 3.12 oe 
(0.79) (0.84) (0.83) (0.87) 
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Appendix F: Summary of Analyses of Survey Responses Given by Students Who Participated in TEAM in Both Grade 7 and Grade 8 


Table F-3. Students’ Behaviors and Skills Related to Communication Using Media, Including Only Those Students Who Participated in TEAM in 
Both Grade 7 and Grade 8 in TEAM Program Years 2 and 3 


Behavior or Skill Related to 
Communication Using Media 


Mean Agreement Rating 
(Response Scale: Strongly Disagree = 1, Kind of Disagree = 2, Kind of Agree = 3, Strongly Agree = 4) 


Grade 7 in Year 2 (2011-12) 


Grade 8 in Year 3 (2012-13) 


n Pre Post Dp n Pre Post Dp 
I enjoy using things like Wikipedia, 
team games, online fan communities, 7.60 781 7.62 764 
and community message boards to 94 (1.01) (0.91) ns 104 (0.84) (0.87) ns 
collaborate and have conversations , : ; , 
with people I’ve never met. 
I like to share links, videos, and other 3.07 3.26 3.11 3.09 
cool stuff on social media sites like 94 (1.06) (0.83) ns 106 (0.92) (0.91) ns 
Facebook, YouTube, or Twitter. . , ; : 
When I can’t solve a problem or find a 
piece of information by myself, I use 3.23 3.29 3.24 3.28 
the Internet or social media to connect 94 (0.85) (0.74) ns 106 (0.63) (0.66) ns 
with others and find what I am looking : ; , , 
for. 
When I go online, I feel like I am part 87 2.97 2.84 o 106 2.97 2.89 as 
of a community. (0.78) (0.86) (0.74) (0.81) 
I act, talk, and treat people differently 90 2.01 2.22 te 107 3.32 2.07 ee 
online than I do in person. (1.02) (1.04) (1.07) (0.98) 
I often comment on articles, photos, or 97 2.79 2.81 de 107 2.78 2.63 = 
videos online. (0.89) (0.97) (0.81) (0.92) 
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Appendix F: Summary of Analyses of Survey Responses Given by Students Who Participated in TEAM in Both Grade 7 and Grade 8 


Table F-4. Students’ Behaviors and Skills Related to Creation Using Media, Including Only Those Students Who Participated in TEAM in Both 


Grade 7 and Grade 8 in TEAM Program Years 2 and 3 


Behavior or Skill Related to 


Mean Agreement Rating 
(Response Scale: Strongly Disagree = 1, Kind of Disagree = 2, Kind of Agree = 3, Strongly Agree = 4) 


Creation Using Media Grade 7 in Year 2 (2011-12) Grade 8 in Year 3 (2012-13) 
n Pre Post D n Pre Post D 
a Tice ae 94 ue 20 ns 107 aoe ae ns 
: ; (0.77) (0.76) (0.74) (0.73) 
drawing, etc. 
I can create art or media that represents 93 2.91 2.99 ak 106 3.00 3.08 a 
who I am. (0.87) (0.80) (0.84) (0.78) 
I feel confident sharing my original 91 2.87 2.88 er 104 2.86 2.91 fs 
creative work with my classmates. (0.90) (0.80) (0.83) (0.78) 
are poe nee 92 mh ae ns 103 oo mae ns 
(0.98) (0.95) (0.91) (0.88) 
online. 
When making a video or creating an 
image, I know how to use visual clues 
to get across information about a 3.00 3.02 3.00 3.06 
character, setting, or other concepts 92 (0.77) (0.77) ns 107 (0.58) (0.63) ns 
(for instance, the type of clothing a j ; ; , 
character wears might tell us about 
them before they even speak). 
I consider myself a media artist or 94 2.48 2.35 os 107 2.46 2.53 ee 
producer.* (0.84) (0.90) (0.82) (0.81) 


*Note: The words “or producer” were omitted in years 3 and 4. 
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Appendix F: Summary of Analyses of Survey Responses Given by Students Who Participated in TEAM in Both Grade 7 and Grade 8 


Table F-5. Students’ Self-Ratings of Their Computer-Related Skills Including Only Those Students Who Participated in TEAM in Both Grade 7 


and Grade 8 in TEAM Program Years 3 and 4 


(Response Scale: No Experience = 1, Basic = 2, Intermediate = 3, Expert = 4) 


Students’ Mean Skill Ratings 


Computer-Related Skill 


Grade 7 in Year 3 (2012-13) 


Grade 8 in Year 4 (2013-14) 


n Pre Post p n Pre Post p 
Point or Keynotein presentations for, | 10 | 245 | 272 | ogy | ans | 277 | 282 | ag 
Aes (0.80) (0.74) (0.77) (0.75) 
Use Excel to make a database or solve 110 2.22 2.25 an 123 2.24 2.32 a 
math problems (0.92) (0.86) (0.81) (0.90) 
Upload or edit my own photos, videos, 2.69 3.00 2.98 3.14 
and sound. a (1.00) (0.88) Sie Hee (0.80) (0.83) ea 
Download and install software from 2.40 2.71 2.98 2.96 
the Internet. ma (1.01) (0.97) wee ns (0.89) (0.90) ia 
Use Google Maps to find information 314 3.24 3.43 3.34 
about a neighborhood or certain 110 (0.87) (0.85) ns 122 (0.72) (0.73) ns 
location , : , : 
Use tools like spell check, calculator, 3.35 3.55 354 3.56 
dictionary, thesaurus, etc. to help me in 110 (0.70) (0. 59) .016 124 (0. 55) (0. 58) ns 
my learning or work , : : ; 
Learn how to do something new ona 
computer, camera, phone, or other 11 3.22 3.30 oe 124 3.34 3.33 oe 
device by seeing what happens when (0.69) (0.73) (0.72) (0.72) 
playing around with it 
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Appendix F: Summary of Analyses of Survey Responses Given by Students Who Participated in TEAM in Both Grade 7 and Grade 8 


Table F-6. Students’ Behaviors and Skills Related to Consumption of Media Including Only Those Students Who Participated in TEAM in Both 
Grade 7 and Grade 8 in TEAM Program Years 3 and 4 


Behavior or Skill Related to 
Consumption of Media 


Mean Agreement Rating 


(Response Scale: Strongly Disagree = 1, Kind of Disagree = 2, Kind of Agree = 3, Strongly Agree = 4) 


Grade 7 in Year 3 (2012-13) 


Grade 8 in Year 4 (2013-14) 


n Pre Post D n Pre Post D 
I am very picky about what I watch, 2.92 3.12 3.03 3.14 
read, and listen to. ve (0.88) (0.78) ute ae (0.86) (0.76) ne 
When I’m interested in a topic or 
issue, I try to get information from a 
bunch of different sources (like TV, 109 ons ae ns 122 om a ns 
radio, the Internet, etc.) to : : : ’ 
understand it more fully. 
When I search for something online 
and I get thousands of results, I can 106 3.22 3.25 oe 120 3.28 3.24 ee 
effectively decide which ones will (0.74) (0.57) (0.64) (0.59) 
be the most useful for me. 
I follow my favorite books, actors, 
shows, musicians, etc. across 
different platforms and media (TV, 108 re ‘oa ns 122 an aan ns 
magazines, Internet, Facebook, . : : : 
Twitter, etc.). 
I can recognize prejudice or bias in 3.00 3.23 3.35 3.36 
media (racism, sexism, etc.). ane (0.85) (0.66) OP ie (0.64) (0.67) ii 
eeu oe imate a 107 ae ae ns 121 sap a ns 

(0.62) (0.67) (0.64) (0.62) 
accurate. 
I think about how people my age, 
ethnicity, and gender are represented 109 3.10 2.96 ae 121 2.97 3.00 er 
in movies, TV shows, and (0.75) (0.77) (0.69) (0.76) 
magazines. 
I only visit websites I know are safe. 3.27 3.07 1.87 3.25 
as (0.81) (0.81) ne nae (0.87) (0.79) ii 


Center for Applied Research and Educational Improvement 


University of Minnesota 


60 


Appendix F: Summary of Analyses of Survey Responses Given by Students Who Participated in TEAM in Both Grade 7 and Grade 8 


Table F-7. Students’ Behaviors and Skills Related to Communication Using Media, Including Only Those Students Who Participated in TEAM in 
Both Grade 7 and Grade 8 in TEAM Program Years 3 and 4 


Behavior or Skill Related to 
Communication Using Media 


Mean Agreement Rating 


(Response Scale: Strongly Disagree = 1, Kind of Disagree = 2, Kind of Agree = 3, Strongly Agree = 4) 


Grade 7 in Year 3 (2012-13) 


Grade 8 in Year 4 (2013-14) 


n Pre Post Dp n Pre Post Dp 
I enjoy using things like Wikipedia, 
team games, online fan communities, 2.67 764 765 267 
and community message boards to 107 (1.01) (0.90) ns 121 (0.94) (0.87) ns 
collaborate and have conversations : : : 7 
with people I’ve never met. 
I like to share links, videos, and other 3.26 3.17 3.16 7.95 
cool stuff on social media sites like 107 (0.94) (0.82) ns 119 (0.79) (0.83) .009 
Facebook, YouTube, or Twitter. . : : : 
When I can’t solve a problem or find a 
piece of information by myself, I use 3.28 3.24 3.39 3.26 
the Internet or social media to connect 108 (0.71) (0.70) ns 119 (0.65) (0.67) ns 
with others and find what I am looking , , : : 
for. 
When I go online, I feel like I am part 2.79 0.79 2.82 2.88 
ofa eat ; ne (0.83) (0.77) us fais (0.75) (0.78) sag 
I act, talk, and treat people differently 108 2.46 2.27 i 122 2.43 2.44 oe 
online than I do in person. (1.02) (1.00) (1.04) (1.09) 
I often comment on articles, photos, or 107 2.82 2.79 re 121 2.47 2.55 fe 
videos online. (0.94) (0.87) (0.93) (0.83) 
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Appendix F: Summary of Analyses of Survey Responses Given by Students Who Participated in TEAM in Both Grade 7 and Grade 8 


Table F-8. Students’ Behaviors and Skills Related to Creation Using Media, Including Only Those Students Who Participated in TEAM in Both 
Grade 7 and Grade 8 in TEAM Program Years 3 and 4 


Behavior or Skill Related to 
Creation Using Media 


Mean Agreement Rating 


(Response Scale: Strongly Disagree = 1, Kind of Disagree = 2, Kind of Agree = 3, Strongly Agree = 4) 


Grade 7 in Year 3 (2012-13) 


Grade 8 in Year 4 (2013-14) 


n Pre Post D n Pre Post D 
I can tell stories in different ways, such 7.93 301 191 7.94 
as through photography, video, writing, 107 (0.82) (0.72) ns 121 (0.78) (0.78) .001 
drawing, etc. 
I can create art or media that represents 2.94 3.09 1.94 3.09 
who Iam. 208 (0.92) (0.80) Me ae (0.84) (0.70) se 
I feel confident sharing my original 2.95 2.96 2.04 2.88 
creative work with my classmates. oe (0.88) (0.83) = ae (0.88) (0.80) osu 
ee | aos, P22 ill ge, +) asa, ee, | | aa 
: (0.91) (0.86) (0.94) (0.84) 
online. 
When making a video or creating an 
image, I know how to use visual clues 
to get across information about a 
character, setting, or other concepts (for 108 a Pike ns 120 23 208 <.001 
: : (0.84) (0.73) (0.67) (0.70) 
instance, the type of clothing a 
character wears might tell us about 
them before they even speak). 
I consider myself a media artist or 106 2.38 2.53 3a 120 2.44 2.47 Se 
producer. * (0.88) (0.84) (0.81) (0.80) 


*Note: The words “or producer” were omitted in years 3 and 4. 
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Appendix G: TEAM and Comparison Students’ Performance on ISAT Reading and ISAT Math 


2010-11 


SCHOOL YEAR: 


Grant Project Year: 


AEMDD Students Comparison Students 
Reading 
Number of Students Taking 738 582 
Reading Test 
Number of Students Scoring 559 A17 
Proficient on Reading Test 
% of Students Achieving 76% 720% 
Proficiency in Reading 
Number of Students Taking 754 589 
Math Test 
Number of Students Scoring 
Proficient on Math Test ak iid 
% of Students Achieving 81% 78% 
Proficiency in Math 
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Appendix G: TEAM and Comparison Students’ Performance on ISAT Reading and ISAT Math 


SCHOOL YEAR: 


Grant Project Year: 


AEMDD Students Comparison Students 
Reading 
Number of Students Taking 690 613 
Reading Test 
Number of Students Scoring 
Proficient on Reading Test aoe =“ 
% of Students Achieving 78% 71% 
Proficiency in Reading 
Number of Students Taking 
Math Test me a 
Number of Students Scoring 
Proficient on Math Test =e oie 
% of Students Achieving ‘ " 
Proficiency in Math Bee uhe 
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Appendix G: TEAM and Comparison Students’ Performance on ISAT Reading and ISAT Math 


SCHOOL YEAR: 2012-13 


C) Pimmtiog Seer | Seams _| Pinel Prefect Tear 


Grant Project Year: | 7 a CJ a 


AEMDD Students Comparison Students 


Reading 


Number of Students Taking 653 595 
Reading Test 

Number of Students Achieving 

Proficiency on Reading Test 220 Zoe 
a ar 

% of Students Achieving 55% AA% 
Proficiency in Reading 

Number of Students Taking 655 574 
Math Test 

Number of Students Achieving 

Proficiency on Math Test iss Zo 
; ae 

% of Students Achieving 5A 41% 
Proficiency in Math 
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Appendix G: TEAM and Comparison Students’ Performance on ISAT Reading and ISAT Math 


SCHOOL YEAR: 2013-14 


C) Pimmatiog Ter | Seams _| Pinel Prefect Tear 


Grant Project Year: | 7 =a CJ a 


AEMDD Students Comparison Students 


Reading 


Number of Students Taking 265 189 
Reading Test 

Number of Students Achieving 

Proficiency on Reading Test ad os 

a en 

% of Students Achieving 570% 37% 
Proficiency in Reading 

Number of Students Taking 273 188 
Math Test 

Number of Students Achieving 

Proficiency on Math Test = uv 

; ar 

% of Students Achieving 67% 37% 
Proficiency in Math 
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